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CHAPTER I 



lOTRODUCTlON 



Pennsylvania established the groundwork for an assessment of educational 
programs through legislation passed in August 1963. The State Board of Educa- 
tion appointed a committee to deve^lop goals of quality education. Toward this 



the coraraictee met witn civic and professional leaders from throughout the 
state and consulted with Educational Testing Service. In March 1965 the fol- 
lowing Ten Goals of Quality Education were adopted: 

I. Quality education should help every child acquire the greatest 
possible understanding of himself and an appreciation of his 
worthiness as a member of society. 

II. Quality education should help every child acquire understanding 
and appreciation of persons belonging to social, cultural and 
ethnic groups different from his own. 

III. Quality education should help every child acquire to the fullest 
extent possible for him, mastery of the basic skills in the 
use of words and numbers. 

IV. Quality education should help every child acquire a positive 
attitude toward the learning process. 

V. Quality education should help every child acquire the habits 
and attitudes associated with responsible citizenship. 

VI. Quality education should help every child acquire good health 
habits and an understanding of the conditions necessary for 
the maintaining of physical and emotional well-being. 

VII. Quality education should give every child opportunity and 
encouragement to be creative in one or more fields of 
endeavor. 

VIII. Quality education should help every child understand the 
opportunities open to him for preparing himself for a 
productive life and should enable him to take full adsrantags 
of these opportunities. 

IX. Quality education should help every child to understand and 
appreciate as much as he can of human achievement in the 
natural sciences, the social sciences, the humanities and 
the arts. 
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X. Quality education should help every child to prepare for a 
world of rapid change and unforeseeable demands In which 
continuing education throughout his adult life should be a 
normal expectation. 

The Bureau of Educational Quality Assessment (EQA) was organized in 

June 1967 to devise Instrumentation and develop procedures for assessment, 

These tasks were accomplished through several phases. 

Phase I 

A search was carried out for suitable Instruments to measure each goal. 
For certain goals standardized published tests were deemed adequate. In 
other goal areas, staff from the Bureau of Research, In cooperation with EQA 
staff developed and pilot tested Items. In April 1968 measurement packages 
were administered to 5th and Uth graders. These data were Item analyzed and 
formed the basis of the final grade 5 and II packages. 

Variables concerning family, community and school conditions which affect 
pupil development were Identified. Procedures for collecting this Information 
were developed, tested and refined. 

Various analytic techniques for the comparison and predictions of school 
means were tested and refined. Computer programs for conducting these 
analyses were devised and refined. 

A publication. Phase I Findings (Campbell, Beers, Coldlron and Hertzog, 
1968) contains extensive Information regarding the measuring procedures. 
Instruments, distribution of pupil scores, and the relationships between 
pupil achievements and school and community conditions. 

Phase II ^ 

During October 1969 the assessment battery was administered to approxi- 
mately 20,000 grade 5 and 17,000 grade 11 pupils. These students came from 
355 elementary schools and 73 secondary schools in Pennsylvania. The sampling 
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I unit was the Individual school building. Stratified random sampling procedures 

I 

I were followed in obtaining a representative sample of Pennsylvania schools. 

' Details are described by Hertzog, Campbell and Beers (1970). 

This normative sample provided the data base for the determination of 
school means which, in conjunction with data from other sources*- Bureau of 
, Statistics records, teachers, and administrators— comprise the complete set 

^ of information for each building. Percentile norms were established for each 

goal area and all condition variables. Regression equations were developed 
for estimating an expected school mean at each goal. The results of these 
analyses and procedural descriptions are given in Campbell, Mull, Laverty, 
Rockey and Stank (1971). A description of the measurement of pupil, school 
and community conditions is provided by Russell (1971). Phase II data were 
also used to derive reliability (internal consistency) estimates for the vari- 
ous instruments. The rationale and technical properties of each insurament 
are described by Beers (1970). A summary of reliability and validity studies 
is given by Toole, Campbell and Beers (1970). 

Phase III 

This phase involves the actual assessment of schools. A school report 
is generated by computer, then is bound and delivered to each school indi- 
vidually by an interpreting team. Because of continued refinements in the 
reporting model, a manual has been prepared each year (e.g., Burson, 1972), 
which explains the type of information found in the school report. Assessment 
began in the fall of 1970 and is now in its third year. 

Purpose of Longitudinal Study 

The primary intent of conducting a longitudinal study was to determine 
the extent to which growth would occur in each goal area and the degree to 
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which pupils maintained their rank order with respect to each goal. A 
sample of 5th grade pupils from schools that were originally involved in 
Phase II was selected. This report describes the changes which took place 
over a two year span. 

Summary of Instruments 

A._brie.f description of each instrument and the technical properties 
is given in the appendix. 



CHAPTER 11 
GENERAL PLAN OF DATA ANALYSIS 



The purpose of this chapter Is to outline the general guidelines under- 
lying the analysis of the longitudinal data. This includes a description of 
demographic variables from which subgroups were formed and the statistical 
procedures used in the analysis. 

Descriptive Report of Results 

This report is essentially a presentation of descriptive findings. 
There is no attempt to integrate the results with relevant research litera- 
ture. 

Description of Variables from Which Subgroups Were Formed 

In addition to the total longitudinal group, analyses are presented for 
particular subgroups. At this point it would be well to provide a description 
of each variable as found on the answer forms. 
SEX 

I am a: Boy ^Girl 

INTER- RACIAL EXPOSURE 

This year are you in any classes or school activities with pupils whose 
race is different from your own? 

Yes No 

RESIDENCE 

In what type of community are you now living? (Your teacher will help 
you with this item if you are not sure*) 

1) In the open country or in a farming community 

2) In a small town (less than 10,000 people) that is 

not a suburb 

3) Inside a medium sized city (10,000 to 100,000 people) 

4) In a suburb of a medium size city 

5) Inside a large city (100,000 to 500,000 people) 

6) In a suburb of a large city 
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7) In a very large city (over 500,000 people) 

8) In a suburb of a very large city 

RACE 

Which of the following best describes you? 

1) Black 

2) White " 

3) American Indian 

4) Oriental ' ZHZIZI 

5) Puerto Rican 

6) Other //[ 

EDUCATIONAL LEVEL OF PARENTS 

This item was completed by the teacher. 

Father's Education : Code the number which represents the highest educa- 
tional level reached hy the pupiPs father or male guardian. 

Mother's Education ; Code the number which represents the highest educa- 
tional level reached by the pupil's mother or female guardian. 

Educational levels 

1) None or some grade school 

2) Completed grade school 

3) Some high school, but not a graduate 

4) High school graduate 

5) Some college, vocational, technical or business school after high 
school 

6) Bachelor's degree 

7) Master's degree 

8) Some work toward a Ph.D. or prof essicxial degree 

9) Ph«D. or professional degree 

Fluctuation of W's 

As will be noted throughout this report, the number of observations on 
which particular statistics are computed will vary considerably due to missing 
data. A frequent practice in survey studies is the isolation of cases with 
complete data for purpose of analysis. This enables one to have a set of 
data whose demographic characteristics are known and constant for all variables 
under analysis and which is, hopefully, not grossly unrepresentative « This 
practice is sometimes encouraged by the fact that the accessible computer 
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programs accept only complete data. In the present study missing data are 
too extensive to indulge in the luxury of analyzing only the subset of com- 
plete data. Considering only the goal scores at grades 5 and 7 there were 517 
complete data records whereas, for the background information (sex, residence, 
etc.) there were 399 complete cases. The number of complete student data 
records (complete data on background and goal s v^s only 323 or 49 per 

cent of the obtained sample of 654. Using only cases with complete data would 
have resulted in a quite unrepresentative residual sample. 

Statistical Procedures Used 

Tests utilized in Chapter III for determining whether the longitudinal 
group means and variances departed significantly from those of the norm group 
are given below. The norm group was the population from which the longitudinal 
group was derived. A z test was conducted (Hays, 1963, p. 250) to determine 
whether the observed longitudinal means were significantly different from the 
population mean (norm group) as follows: 

z = — Where X = longitudinal group mean 

m 



A = population (norm group) mean 

^m = standard error of mean 

s: population steindard deviation 

n = size of sample (number of casis on 
which a particular longitudinal group 
mean is based) 



Testing the significance of differences between the variances of the respec- 
tive groups was accomplished by computing a X and converting to a z (Hays, 
1963, p. 344). 
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(2) 2 = ^" " Where n s size of sample (number of cases 

^ ^^ on which a particular longi- 

tudinal group variance is based) 

= Z(X^ - X)2/(n-l) 

^3) z = ylX • ^2df - 1 (7^ = population variance 

df = n - 1 

In Chapter IV which describes the results for the total longitudinal 
sample, correlation matrices are presented for grades 5 and 7 separately and 
the factor structure examined for each level. In addition, means and standard 
deviations are presented at each grade level together with dependent t-tests 
for evaluating differences between grade 5-7 means and variances. The 
computational formula for contrasting dependent means is (Guilford, 1965, p. 
177): 

(4) t = ^7 ■ ^5 



I 2 2 



The formula for contrasting dependent variances is (Guilford, 1965, 
p. 193): 



(5) t=:7 



s^ - Jn - 2 



In formulas (4) and (5) the subscripts refer to grade level and: 
= mean 

2 2 
s = variance error of mean s /n 
m 

s = standard error of mean = / s^ 
^ \/ m 

= Pearson r between scores at the two points in time 
s^ = estimated variance = 2I<Xj - X^) / (n - I) 
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s = estimated standard deviation s Js^ 
n = number of paired observations 

Chapters V, VI, VII and VIII involve analyses for various subgroups. 
The analyses described for the total sample are repeated in the remaining 
chapters except for the correlation matrices and factor analyses. In addition, 
tests were carried out to determine whether across time correlations differ 
from subgroup to subgroup. Toward this end Fisher •s z transformation was 
employed (Hays, 1965, p. 532): 



z - z 
r r 

t6) z = ^ ^ where = transformed r 



1=3— T 



n = number of observations 
a, b = subscripts denoting subgroups 



For the cuse where more than two groups are to be compared, the formula 
becomes ) 

(7) = I(n. - 3) a - U) where U = 

3 ^3 

S(n - 3) 
3 

and df = j-l 

Tests were also conducted for comparing the subgroups with respect to 
means and variances of each goal area. The variances were tested via Hartley's 
F-max (Kirk, 1968, p. 62): 

'I 

(8) F = — where s^^ = largest variance 



2 

s« 2 



s = smallest variance 
s 
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In order to test for significant dlfferencec among means the Welch 
procedure was chosen. This method has been found to be robust when variances 
are heterogeneous and n's unequal (Kohr, 1970; Scheffe, 1970; Wang, 1971). 
This procedure, described In Winer (1962, p. 37) and Kirk (1968, p. 98), 
appeared to be the method of choice since none of the subgroups had equal 
numbers of observations* The technique Involves the computation of a ratio 
labeled as t« in this report and an adjustment to degrees of freedom, labeled 
as df>. 

X . X 
a b 

(90 V = 

H' 2 . 

/ + Sb / nb 

2 

(df^) (df, ) ^a / "a 

(10) df* = ? ^ where C = _____ 

dfgC^ + dfi (1 . C)2 ^ ' "a 4 ^ "b 

The very large volume of significance tests performed makes the likelihood 
very great that certain significant results will be obtained by chance alone. 
Ideally, multivariate statistical methods should be applied In which protection 
against Type I errors (falsely rejecting the null hypothesis) Is extended 
across the entire set of variables. This was not feasible In the present cir- 
cumstances because multivariate programs readily available do not accept incom- 
plete data sets, 

A difficulty In Interpreting differences when they are found to be sta- 
tistically significant lies in the judgment as to their substantive signifi- 
cance. The question of how big a differential (In observed score units) makes 
a practical difference Is not easy to answer. Attention needs to be directed 
to this problem because small, trivial differences can easily be found sig- 
nificant when n Is large. Further, the probability level at which an observed 
difference Is found significant Is not an Index of Its Importance. Guidelines 
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which may be applied in a determination of importance have been worked out by 
Cohen (1969). His concept of "effect size'* is most relevant for present pur- 
poses. When means are to be contrasted, Cohen defines effect size (d) in 
terms of standard units, i.e., the size of the difference relative to the 
common standard deviation (p. 18): 



(11) 



d = 



where and are group means 

O* = common population standard 
deviat ion 



In the examination of longitudinal and norm group means (Chapter III) 
the effect size may be represented as (p. 43): 
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d rr 



where Xj^= longitudinal mean 

A = population mean (norm group) 
- population standard deviation 

An effect size determination may also be constructed for the case of 
correlated means, as when the means at grades 5 and 7 are to be contrasted. 
Effect size d for this case may be computed as follows (p. 46): 



(13) 



d rr 



IS - s 



where X^ and X are the grade 7 and 5 
means 

r~2 2 

s« = + s^ - 2r s s 
z J 5 7 57 5 7 



s ,s, and r are as defined under (5) 

A related but somewhat different concept of effect size is employed when 
subgroup means are contrasted as in Chapters V, VI,y€tcT Effect size may be 
thought of in terms of correlation and proportion of variance accounted for. 
When two groups are compared (e.g., male-female), membership in a group may be 



-12- 

scored dichotoraously (e.g., l=male, 2=female). A Pearson r may be computed 

between group membership and t^^variable of interest (i.e., goal scores). 

In this special case, where a dichotomous variable (X) is correlated with a 

continuous variable (Y), the term point biserial r is often applied. The 

square of this correlation yields the proportion of Y variance accounted for 

by the X variable (and vice versa). Cohen (p. 20) presents a table of 

equivalents for effect size, as d, and other indices including r and r . A 

small effect is defined as ad of .2, the equivalent r and r^ values being 

.10 and .01. A medium sized effect is considered to be a d of .5 with ah 
2 

equivalent r and r of .24 and .06. A large effect is regarded as a d of .8 
with corresponding r and r^ values of .37 and .14. 
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CHAPTER III 
THE SAMPLE 

As indicated in Chapter I, 355 elementary s:chools comprised the sample of 
schools deemed representative of the state during the 1969 norming operation 
(Phase II). During the spring of 1971 a subset of these schools was selected 
for participation in the longitudinal study. The general plan called for 
pupils who had been tested in 5th grade (October 1969) to be retested with 
the same battery in October 1971 thereby yielding data across a two year 
span. To accomplish this task, schools housing these pupils when they were 
5th graders had to be contacted in order to ascertain which junior high 
schools were recipients of their "graduates." 

Concomitant with the development of plans for the conduct of the longi- 
tudinal study was the establishment of plans for the October 1971 field test- 
ing (Phase I) of the prospective 7th grade assessment package. Various 
factors including budget constraints posed limits on how many pupils could be 
tested. This meant that the total number of pupils, longitudinal and Phase I 
together, could not exceed a certain number. Changes were made in the plans 
for the two operations at various stages of development. Consequently, the 
method of selecting the subset of schools which ultimately participated in the 
longitudinal study is somewhat difficult to describe. 

Sample Selection Procedures 

Initially, the 355 Phase II elementary schools were rank ordered with 
respect to an index of socioeconomic status (Reiss, Hatt and North, 1961). 
A systematic sample of 50 schools was then selected by taking every seventh 
school. Following this was a decision to involve fewer schools in the 
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longitudinal study in order to permit a greater number of students to be a 
part of the 7th ^rade, Phase I field testing. Twenty schools were then 
selected from the previous 50 by taking alternately, every second, then every 
third school, e.g., 2, 5, 7, 10, 12, 15, . . .,50. 

Administrator<? of these 20 schools were asked to identify the junior 
high schools receiving pupils from their elementary schools. A printout 
listing the names of the pupils associated with a particular Phase II ele- 
mentary school was then sent to the administrator of the appropriate junior 
high schooKs). Administrative staff were requested to cross off the names of 
those children whom they did not have currently enrolled. 

Those pupils who were enrolled became candidates for selection into the 
longitudinal group with one important exception. In cases where two or more 
junior high schools vzere recipients of pupils from a given elementary school, 
only the junior high receiving the largest proportion was permitted to par- 
ticipate. About half of the elementary schools supplied two or more sec- 
ondary schools. The major recipient school received at least 80 per cent of 
the children from a given elementary school. This circumstance can be a 
source of bias If systematic differences exist between the up to 20 per cent 
who filtered into other schools and those entering the main recipient school. 
Unfortunately, procedures were never established to determine the amount of 
potential bias at precise time the "candidate pool*' was being developed. 
Currently, there is no easily available Information to bring to bear on the 
problem. Thirty-five 7th grade pupils were randomly selected via a random 
numbers table from the candidate pool within each of the 20 junior high 
schools. To be tested then, were 700 pupils. Of these, 46 were either no 
longer enrolled or were absent on the day of testing and were lost to the 
sample. Hence, the final longitudinal sample consisted of 654 cases. 
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Missing Data and Scoring Adjustments 

Unfortunately, steps were not taken to Interrogate the student records 
from the grade 5 data tape for completeness prior to sample selection. As a 
result the grade 5 Information has a considerable sprinkling of missing data. 
Part of the information loss was due to the original scanning of the grade 5 
answer forms. Specifically the problem centers on answers to a question con* 
ceming the pupiPs area of residence (i.e., open country, small town, medium 
sized city, etc.) which has 8 categories. The proper coded value for five of 
these categories was properly transmitted to the tape; however, the other three 
were transmitted as zeros, ordinarily indicative of an omit. Consequently, 
the incidence of non-response for the variable RESIDENCE is very much inflated. 

Missing data are also a problem in the goal areas. The N column for the 
longitudinal sample in Table 2 reveals how many "valid records" there were in 
the grade 5 data. Subtracting the Np column in Table 7 from these figures 
yields the number of "invalid records" occurring for each goal area at grade 
7. A valid record for goal area is defined in terms of the percentage of 
items attempted. Specifically, a valid student record is one in which at 
least 80 per cent of the items have been responded to. An invalid record is 
one having an insufficient number of responses to be scored, i.e., less than 
80 per cent attempted. 

Exceptions to this rule occur for Goals III and VI which are achievement 
tests and are scored according to the number correct. In the case of the other 
goals, which are composed of attitude scales, the failure to respond to 
several items can result in a spuriously low score. For those cases having 
omits, but meeting the criteria of a valid record, the following formula was 
applied which serves to estimate the pupiPs total goal score had he answered 
every item: 
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S X K 

T Where T = estimated total score 



S = sum of items responded to 

K = number of items on the scales 

I = number of items responded to 

Representativeness of Sample 

The problem of representativeness is inherent in any longitudinal study. 
Of particular concern is the problem of subject loss. In the present study 
the problem is compounded by the procedures used in obtaining the sample. 
There are, of course, multiple sources of contamination. If one is willing to 
assume that the approximately 20,000 children who were tested in 1969 during 
Phase II form a representative sample of Pennsylvania 5th graders, the problem 
is somewhat reduced. The problem becomes a question of how representative of 
the norm sample is the resultant longitudinal sample. 

In order to estimate the comparability of the longitudinal and the 1969 
norm sample, descriptive indices were developed on relevant background vari- 
ables for which data were available. These figures are presented in Table 1. 
The percentage of cases falling into various subgroups is similar for the 
longitudinal and norm samples with no gross deviations. Indeed, there seems 
to be sufficient comparability to warrant the conclusion that the longitudinal 
group is representative of the norm sample. It should be re-emphasized that 
the high incidence of non- response for the variable RESIDENCE is largely 
inflated as a result of an error in production of the Phase II data tapes. 
For example, all the children attending school in inner city Philadelphia 
should have an appropriate RESIDENCE code. Instead, they are incorrectly 
represented by a zero. In the author's opinion, the incidence of true non- 
response for this variable is ordinarily quite low and the non-responders in 
the norm and longitudinal samples are found predominately in urban areas. 



TABLE 1 



Comparability of Longitudinal Seimple with 1969 Norm 
Sample in Terms of Background Characteristics 



Longitudinal Norm 
Sample Seimple 



Variable 
1. SEK 



(N=654) (N^ 20,000) 



Male 48.6% 49.3% 

Female 51.2 47.2 

Non- Response 0.2 3.5 

2. INTER- RACIAL MIJCTURE 

Yes 42.8 41.6 

No 52.0 54.4 ^ 

5.0 



Non- Response 5.2 



3. RESIDENCE 

Open country 26.3 29.8 

Small town 25.5 28. 1 

Medium city 10.4 10.1 

Suburg medium city 8.1 8.1 

Large city 4.4 3^4 

Non-Response^ 25.2 20.5 

4. RACE 

Black 6.4 6.4 

White 88.1 82.7 

Amer. Indian 1.8 2.4 

Oriental 0.2 o!? 

Puerto Rican 0,5 0.4 

Other 0.1 olo 

Non-Response 2.9 7^4 

5. EDUCATIONAL LEVEL OF PARENTS 





Fathers 


Mothers 


Fathers 


Mothers 


Some grade school 


1.7% 


0.8% 


1.8% 


1.1% 


Completeii grade school 


4.4 


3.4 


7.2 


5.0 


Some high school 


21.7 


20.0 


21.1 


21.3 


High school graduate 


30. 1 


40.7 


34.7 


44.4 


Some advanced education 9.5 


9.5 


8.5 


8.2 


Bachelor' s degree 


7.3 


4.0 


6.7 


4.5 


Masters degree 


1.2 


0.2 


1.5 


0.4 


Masters degree plus 


0.9 


0.0 


0.5 


O.l 


Doctorate 


0.6 


0.0 


1.3 


0.4 


Non -Response 


22.5 


21.6 


16.7 


14.7 



^Inflated by error In production of Phase II data tapes. 
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The high incidence of non-response in the EDUCATIONAL LEVEL variable 
likely comes from not knowing or not wishing to reveal the information. 

Comparability may also be examined by contrasting the groups with respect 
to means and standard deviations of each goal area. Regarding the norm group 
as the population and the longitudinal group as a sample from that population^ 
one may apply statistical tests to determine whether significant departures 
exist. Summarized in Table 2 are the means and standard deviations for the 
longitudinal and norm groups. 

A z test (see Chapter II for details) was used to determine whether the 
longitudinal grade 5 means differed significantly from those of the norm group. 
All tests were non- significant with the exception of Goal IV (z = 2.84, p <.01), 
Goal V (z s= 2.76, p<.01), and Goal VII (z = 2.78, p<.01). To assist in 
evaluating these significant differences one can examine the ''effect size" by 
forming a ratio of the observed difference to the population standard deviation 
(Cohen, 1969). For these three goals the observed differences are all .11 of 
a standard deviation. In each case the effect size is quite small (only about 
one- tenth of a standard deviation) and can be safely disregarded. 

In order to determine whether the longitudinal group variances departed 
significantly from the norm group, a X was computed and converted to a z 
(see Chapter II for details). None of these tests revealed statistically 
significant differences. 

Summary 

With regard to the statistical results, the longitudinal group, in 
general, appears to be fairly representative of the norm group from which it 
was derived. A slight positive bias in favor of the longitudinal group was 
observed for the means of three goal areas. When considering the substantive 
significance of these deviations, it was concluded that they were trivial and 



TABLE 2 

Comparability of Longitudinal Sample with 1969 Norm Sample 







In 


Terms of Total 


Goal Scores 








Longitudinal Sample (1969 data) 


Norm 


Sample 


(1969) 


Goal 


N 


Mean 


SD 


n" 


Mean 


SD 


I 


636 


87.59 


8.08 


19435 


87.02 


8.09 


II 


641 


32.86 


5.41 


19405 


32.48 


5.34 


III-V 


638 


15.94 


5.26 


19618 


15.99 


5.36 


III-M 


642 


17.41 


4.49 


19738 


17.59 


4.50 


IV 


632 


59.82 


9.29 


19444 


58.82 


8.85 


V 


628 


163.16 


22.01 


19372 


160.83 


21.01 


VI 


617 


28.73 


6.75 


19301 


28.22 


6.51 


VII 


630 


139.90 


16.28 


19465 


138.16 


15.53 


VIII 


629 


60.04 


5.22 


19487 


59.90 


5.15 


IX 


641 


52.04 


5.36 


19456 


51.84 


5.49 


X 


634 


102.33 


16.03 


19414 


100.99 


16.07 
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could reasonably be disregarded. There is, of course, the possibility that 
the sample does depart from the norm group in othei important but unmeasured 
ways* 
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CHAPTER IV 
RESULTS FOR TOTAL SAMPLE 

Relationships Among Goals 

Summarized in Tables 3 and 4 are the inter-goal correlations at grades 5 
and 7. Due to missing data the number of observations (n) for each r is some- 
what different. The n's range from 597 to 637 at grade 5 with a median n of 
620. At grade 7 the range is from 603 to 636 with a median n of 621. There 
is a slight tendency for the r's to be higher at grade 7 (42 of the 55 r»s 
showed a slight but generally trivial increase). It^^y be that pupil growth 
in reading ability is responsible for the observed increase. In general, the 
pattern of r»s appears quite similar for the two grade levels* 

In order to get a further indication of the comparability of the two 
correlation matrices, the factor structure was examined. Toward this end, 
the correlation matrix at each grade level was subjected to a principal com- 
ponents analysis followed by varimax rotation. The three factor solution for 
each grade level appeared to be the most interpretable. Tables 5 and 6 con- 
tain the rotated factor loadings for grades 5 and 7. The first three factors 
account for about 57 per cent of the variance at grade 5 and about 62 per cent 
at grade 7* The contribution of each factor to total variance is similar at 
each grade level. An examination of the loadings for each goal reveals 
essentially the same pattern at both grade levels* Goal I appears to be 
factorially complex, judging £rom the moderate size of the loadings across 
factors. Goal II has rather moderate loadings on factors I and II. Goals 
III-V and III-M are clearly identified with factor I and Goal IV with factor 
II. Goal V loads on the first two factors at grade 5 but shows a trend toward 



Table 3 ^ 

Correlations Between Goal Areas at Grade 
for Total Longitudinal Sample (N=654) 



Goal 


I 


II 


III-V 


III-M 


IV 


V 


VI 


II 


. 14 














III-V 


.27 


.21 












III-M 


.20 


.14 


.61 










IV 


.27 


.24 


.19 


.13 








V 


.32 


.29 


.43 


.34 


.50 






VI 


.29 


.28 


.59 


.49 


.20 


.50 




VII 


.34 


.28 


.39 


.32 


.38 


.57 


.46 


VIII 


.37 


.16 


.42 


.27 


.11 


.30 


.38 


IX 


.15 


.11 


.06 


.05 


.34 


.29 


.06 


X 


.03 


.07 


.03 


.04 


.08 


.05 


.07 



Table 4 

Correlations Between Goal Areas at Grade 7 
for Total Longitudinal Sample (N=654) 



Goal 


I 


n 


III-V 


III-M 


IV 


V 


VI 


II 


.22 














III-V 


.28 


.25 












III-M 


.23 


.17 


.66 










IV 


.30 


.27 


.10 


.08 








V 


.40 


.33 


.32 


.33 


.54 






VI 


.30 


.32 


.60 


.52 


.20 


.53 




VII 


.34 


.33 


.27 


.26 


.52 


.65 


.42 


VIII 


.42 


.27 


.51 


.40 


.18 


.40 


.49 


IX 


.23 


.22 


.09 


.09 


.48 


.46 


.22 


X 


.00 


.10 


-.01 


.01 


.13 


.06 


.04 



Table 5 

Matrix of Rotated Factor Loadings at Grade 5 



Factor 



Goal 


1 


II 


III 


h? 


I 


.25 


.48 


.35 


.41 


II 


.24 


.40 


-.04 


.22 


III-V 


.84 


.15 


.05 


.73 


III-M 


.80 


.04 


-.08 


.65 


IV 


.01 


.79 


.00 




V 


.41 


.69 


.07 


.65 


VI 


.78 


.25 


.04 


.66 


VII 


.42 


.62 


.12 


.58 


VIII 


.50 


.22 


.46 


.51 


IX 


-.10 


.66 


-.32 


.55 


X 


.13 


.14 


-.82 


.72 


Sum of 

Squared Loadings 


2.69 


2.45 


1.16 




Per cent of Trace 


24.45 


22.27 


10.55 





Table 6 



Matrix of Rotated Factor Loadings at Grade 7 



Factor 



uoai 




II 


III 


.2 
h 


1 




AO 


.38 


.46 


II 


.30 


.42 


-.10 


.28 


III-V 


.88 


.06 


.02 


.78 


TTT M 










IV 


-.04 


.81 


.00 


.66 


V 


.35 


.75 


.09 


.70 


VI 


.76 


.31 


-.00 


.67 


VII 


.28 


.76 


-.06 


.65 


VIII 


.62 


.31 


.32 


.59 


IX 


.01 


.73 


-.17 


.57 


X 


.03 


.20 


-.89 


.83 


Sum o£ 

Squared Loadings 


2.80 


2.98 


1.09 




Per cent of Trace 


25.45 


27.12 


9.88 
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a stronger identification with factor II at grade 7. Goal VI demonstrates a 
high loading on factor I and a fairly low loading on factor II. At Goal VII 
moderate loadings may be observed on the first two factors; however, at grade 
7 factor II emerges as the more salient. At grade 5 Goal VIII has very simi- 
lar loadings on factors I and III but at grade 7 the picture becomes one in 
which factor I contains the strongest loading with somewhat weaker loadings on 
factors II and III. Goal IX beceime more strongly identified with factor II by 
grade 7 and Goal X displayed strong identification with factor III at both 
grade levels. In summary, Goals III-V, III-M, IV and X displayed great simi- 
larity in the sense that very high loadings were found on a particular factor 
and quite negligible loadings on the other two factors. There was very little 
difference in these loadings at the two grade levels. Goal VI also showed 
great stability although the next highest loading was in a borderline zone as 
far as size is concerned. Goals I and II remained factorially complex in 
about the same degree. Goals V, VII, VIII and IX demonstrated an increase in 
factorial identification from grade 5 to grade 7. This was evidenced by an 
increased loading on the factor having the higher loading at grade 5 and a 
decrease in the next highest loading. 

Across Time Correlations 

The correlations between grade 5 and grade 7 scores at each goal are 
termed across time correlations in this report. They indicate the degree of 
stability over a two year span. As one might expect the greatest stability 
was shown for the cognitive areas, Goals III-V, III-M and VI. Moderate 
stability was exhibited for Goals I, V, VII and VIII. Rather weak correla- 
tions were observed for Goals II, IV, IX and X. All of the correlations are 
statistically greater than zero by virtue of the sample size. Therefore, in 
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evaluating the importance of the across time relationships, attention should 
be focused on the amount of variance accounted for. 

Shifts in Means from Grade 5 to 7 

Statistically significant changes occurred in all goal areas except V 
(citizenship). In two instances there was a decrement, in all other areas 
the means increased. To help evaluate the practical importance of these 
shifts, Cohen's d index is employed. Table 8 summarizes the d values for 
each goal area; 

Table 8 

Substantive Significance of Grade 5-7 Mean Shifts 

Goal Area 

I II ILty in-M ly V VI VII viii ix x 

d value .14 .25 1.23 1.22 .20 .02 .68 .12 .66 .14 .21 

Goals IV (interest in school) and IX (appreciating human accomplishments) 
displayed a downward shift in the group means. This would suggest that a 
decline in pupil's interest in school takes place between grades 5 and 7. 
Likewise students would seem to view various human accomplishments in less 
esteem. The diminished interest in school is not unexpected; however, the 
decrease is only about two- tenths of a standard deviation which Cohen regards 
as a lower limit for a small effect. Although the shift is relatively small, 
its importance lies in whether this trend continues for each school year. 
This, of course, cannot be known from the data here, but something which 
further longitudinal investigations may reveal. However, the present finding 
is consistent with those obtained by two cross- sectional investigations. In 
a study involving grades 6, 7, 8 and 9 Yaraamoto, Thomas, and Karns (1969) found 
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that ratings of teachers and overall curriculum became progressively more 
negative across grade levels. These authors note that their results are con- 
sistent with those obtained by Neal and Proshek (1967) in a study of cul- 
turally advantaged and disadvantaged elementary school children. The decrease 
in appreciating human accomplishments is only . 14 of a standard deviation and 
can hardly be considered as an important change. The failure of this goal 
area to show an increase may be related to a developing differentiation of 
interests at this age range. At grade 5 there may be more of a generalized 
tendency to enjoy witnessing various types of performances. By grade 7 chil- 
dren's likes and dislikes may be more developed such that an increase in 
overall score not observed. In other words, important and interesting changes 
may be occurring between grades 5 and 7 but they are not reflected in a change 
in overall means. It is interesting to note that a statistically significant, 
although small, increase in variability occurred. This finding is consistent 
with the notion of a greater differentiation of attitudes toward various human 
accomplishment s . 

The increases found for Goals III-V and III-M were of major proportion, 
nearly one and a quarter standard deviations. This should be expected since 
the instruments deal with verbal analogies and mathematics. A failure to 
exhibit an increase in these areas would be most remarkable indeed. 

Sizable gains were also observed for Goal VI (health) and Goal VIII 
(vocational development). Here again, substantial gains are expected. The 
Goal VI ins:rument is essentially a measure of health knowledge. The Goal 
VIII instriment is a measure of vocational maturity and its development 
leaned heavily on the items demonstrating growth over time. Hence, there 
would appear to be an increased maturity in vocational attitudes in the 
longitudinal sample. 
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Galns of a small effect size were observed at Goals II (attitude toward 
differing others) and Goal X (preparing for a changing world). This would 
suggest that a more positive attitude toward persons who differ in significant 
ways is being developed. Likewise some improvement in attitudes deemed impor- 
tant in coping with life changes seems to be taking place* 

Although the increase is statistically significant at Goal I (self 
concept) and Goal VII (creative attitude), the changes are only .14 and .12 
of a standard deviation. 

Shifts in Variability from Grade 5 to 7 

Only two significant changes in variability occurred. A significant 
decrease was observed at Goal II. This may indicate a trend toward greater 
homogeneity in attitudes toward differing others. Another possibility is 
that a ceiling effect is depressing the variability. A significant increase 
in variability was found for Goal IX and was discussed above. 
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CHAPTER V 
MALE- FEMALE DIFFERENCES 

The statistical sununary for males and females is presented in Tables 
9 and 10, respectively. The results of various aspects of the analysis are 
described below. 

Across Time Correlations 

The pattern of across time correlations for the male £Uid female groups 
is highly similar to each other and to the total group. Lach across time 
correlation for the male group was statistically compared (see Chapter II 
for details) with the respective correlation in the female group. None of 
these comparisons revealed a significant difference between correlations. 

Shifts in Means from Grade 5 to 7 

The males displayed statistically significant gains in six goal areas; 
in Goals V and VII the differences were non-signif leant . In Goals IV and IX 
a significant decrement took place. 

Females, likewise, exhibited a significant decrement in Goal IV and 
showed no significant change in Goal V. They were also like the males in 
exhibiting significant gains in Goals II, III-V, III-M, VI, VIII and X. In 
contrast, the female group showed a significant gain in Goal VII, but no 
significant differences in Goals I and IX. 

The substantive significance of these shifts, in terms of Cohen's d 
index, is displayed in Table 11 below. 
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Table 11 

Substantive Significance of Grade 5-7 Mean Shifts 
at each Goal Area for Male- Female Groups 



Goal Area 



Group 


I 


II 


III-V 


III-M 


IV 


V 


VI 


VII 


VIII 


IX 


X 


Male 


.16 


.20 


1.25 


1.20 


.24 


.03 


.56 


.03 


.60 


.24 


.20 


Female 


.J2 


.29 


1.22 


1.24 


.17 


.08 


.85 


.21 


.70 


.06 


.20 



A gain magnitude in excess of a standard deviation was obtained for Goal III, 
Rather sizeable gains also occurred for both sexes in Goals VI and VIII. The 
effect size for statistically significant changes in Goals II, IV (males), 
VII (females), IX (males) and X was in the small range (.20 < d ^ ^29). 

Differences in Mean Goal Scores for Males and Females 

The means for the male-female groups were also contrasted across each 
goal/grade area. The results of these tests are summarized in Table 12, The 
means and standard deviations are not shown since they are displayed in Tables 
9 and 10. A negative t» reflects a higher female mean on the variable in 
question. The table also contains the correlation (r) between group member- 
ship and each particular goal score and (r ) the proportion of variance 
accounted for (see Chapter II for details). Most of the comparisons are not 
statistically significant. None of the significant differences reached a 
moderate effect size, i.e, an r = ,24, r = .06 which is approximately com- 
parable to d s «5. 

In Goal IV males exhibited lower means (indicative of a lower interest 
in school) than females at both grade levels. These differences, while 
statistically significant, are relatively weak as shown by r values of -.12 
and -.l? which are approximately equivalent to d values of .2 and .3* 
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Table 12 

SuTimary of Male- Female Mean Contrasts 



Goal 


Grade 




df 


_r 


2 

r 


I 


5 


-0.36 


611 


-.01 


.00 


I 


7 


0.14 


610 


.01 


.00 


II 


5 


-0.26 


602 


-.01 


.00 


II 


7 


-0.98 


573 


-.04 


.00 


III-V 


5 


-0.54 


609 


-.02 


.00 


III-V 


7 


-0.16 


610 


-.01 


.00 


III-M 


5 


2.50a 


609 


.10 


.01 


III-M 


7 


2.19 


612 


.09 


.01 


IV 


5 


-2.91b 


605 


-.12 


.01 


IV 


7 


-4.25b 


576 


-.17 


.03 


V 


5 


-3.S0b 


581 


-.16 


.03 


V 


7 


-5. 12b 


583 


-.20 


.04 


VI 


5 


-2.28 


585 


-.09 


.01 


VI 


7 


-3.59b 


571 


-.15 


.02 


VII 


5 


-1.93 


608 


-.08 


.01 


VII 


7 


-4.17b 


597 


-.17 


.03 


VIII 


5 


-0.76 


607 


-.03 


.00 


VIII 


7 


-2.19 


608 


-.09 


.01 


IX 


5 


-3.45b 


596 


W.14 


.02 


IX 


7 


-5.42b 


601 


-.21 


.05 


X 


5 


1.13 


603 


.05 


.00 


X 


7 


1,15 


593 


.05 


.00 


a = obtained 
b s obtained 


difference 
difference 


significant at 
significant at 


.01 level 
.001 level 
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Males displayed significantly lower means in Goal V (citizenship) at 
both grade levels. The r values of -.16 and -.20 convert to d values of 
approximately .3 and .4 points which are somewhat between Cohen's guide- 
lines for small and moderate effects. 

Females also displayed significantly higher means at both grade levels 
in Goal IX (appreciating human accomplishments). The r values of -.14 and 
-.21 are approximately equivalent to d values of .3 and .4. Again the 
differences can be regarded only as slight. 

For Goals VI (health) and VII (creativity) the differences are non-signi« 
ficant at grade 5, but significant at grade 7. This type of finding is 
suggestive of an ordinal interaction (Lubin, 1962). An examination of the 
Goal VI means, however, reveals an increase for both males and females; but 
the magnitude of the increase could hardly be regarded as sizeably higher 
for the female group. Something more akin to a meaningful interaction may be 
observed for Goal VII. Here, the females displayed a significant, although 
slight, increase. The males failed to demonstrate a significant gain. Since 
the male-female means were not statistically different at grade 5 but do 
diverge significantly at grade 7, it may be concluded that the female group 
did show a small gain, whereas the males did not. 

Shifts in Variances from Grade 5 to 7 

As may be seen from Table 9 only one statistically significant change 
in variability occurred for the males. For Goal IX a significant increase 
was found although the magnitude of the differences does not appear to be 
very, great. Similarly, the females displayed a significant increase at Goal 
IX. Additionally, the females revealed a significant decrease in variability 
for Goal II. 
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Differences in Variability for Males and Females 

Six of the 22 comparisons were found to be statistically significant at 
the .01 level. In five cases, the males exhibited greater variability although 
the variance ratios were not great, the largest being 1.51. These occurred 
for the following goal-grade areas: II-7, IV-7, V-5, V-7 and VI-7. The 
female group exhibited greater variability at VIII-5, although the difference 
was not great. 
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CHAPTER VI 

DIFFERENCES BETWEEN INDIVIDUALS HAVING AND NOT HAVING INTERRACIAL EXPOSURE 

The statistical sunmaary for those individuals claiming interracial 
exposure is presented in Table 13, Table 14 contains the statistical summary 
for those individuals not claiming to experience exposure to persons of 
another race. For ease of communication, the two groups will hereafter be 
referred to as "exposure** and "non-exposure," respectively. 

Across Time Correlations 

The pattern of across time correlations for the two groups is very 
similar. Each across time correlation for the exposure group was statistically 
contrasted with the respective correlation in the non-exposure group. None 
of these companions revealed statistically significant differences. A sig- 
nificance level of .01 was employed for all tests. 

Shifts in Means from Grade 5 to 7 

Both the exposure and non-exposuro groups demonstrated statistically 
significant increases in Goals II, III-V, III-M, VI, VIII and X, Both groups 
also revealed a significant decrement in Goal IV. In addition, the exposure 
group showed a significant increment in Goal VII and the non-exposure group 
a significant decrement in Goal IX. 

In order to evaluate the statistically significant shifts in terms of 
their practical significance, Cohen's d index was computed. These values are 
displayed for both groups in Table 15 below. 
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Table IS 

Substantive Significance of Grade Five- Seven Mean 
Shifts at each Goal Area for Exposure and Non Exposure Groups 



Goal Area 



Group 


I 


II 


III-V 


III-M 


IV 


y 


VI 


VII 


VIII 


IX 


X 


Exposure 


.13 


.27 


1,26 


1,25 


.18 


.04 


.66 


.20 


.56 


. 11 


,18 


Non-Exposure 


.12 


.21 


1.25 


1.18 


.21 


.00 


,71 


.07 


.74 


.17 


.20 



For both groups major increases took place for Goals III-V, III-M, VI, and 
VIII. The observed increase at Goals II and VII for the exposure group 
reached Cohen's criterion for a small effect. The non-exposure group demon- 
strated a small effect increase for Goals II and X and decrease for Goal IV. 

Differences in Mean Goal Scores for Exposure and Non- Exposure Groups 

The means for the exposure and non-exposure groups were contrasted at 
each goal/grade area. The results of these significance tests are summarized 
in Table 16. Since the means and standard deviations are shown in Tables 13 
and 14, they are not repeated. A negative t> reflects a higher non-exposure 
mean on that variable. The table also contains the correlation (r) between 
group membership and each goal score and the proportion of variance accounted 
for (r ). The only statistically significant differences occurred at both 
grade levels for Goal III. Here, the r's range from -.13 to -.18 and are 
indicative of small effects (r's convert to d values of .2 to .3). The 
results indicate that the non-exposure group exhibited slightly higher verbal 
and math scores at both grade levels. In the predominantly attitudinal areas 
the two groups exhibited similar mean scores. 

The lack of significant differences between the exposure and non-exposure 
groups should not lead to the conclusion that interracial mixture has little 
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Table 16 

Summary of Contrasts Between Means of Exposure and Non- Exposure Groups 



Goal 


Grade 


t^ 


df ' 


1^ 


r2 

L 


I 


5 


0.37 


559 


.02 


.00 


I 


7 


0.50 


583 


.02 


.00 


II 


5 


0.01 


586 


.00 


.00 


II 


7 


0.45 


562 


.02 


.00 


III-V 


5 


-3.32b 


574 


-.13 


02 


III-V 


7 


-3. 17b 


538 


-.13 


,02 


III-M 


5 


-4.43b 


572 


-.18 


.03 


III-M 


7 


-3.83b 


561 


-.16 


.02 


IV 


5 


0.51 


522 


.02 


.00 


IV 


7 


0.81 


547 


.03 


.00 


V 


5 


-0.93 


541 


-.04 


.00 


V 


7 


-0.36 


550 


-.01 


.00 


VI 


5 


-1.77 


549 


-.07 


.00 


VI 


7 


-1.38 


547 


-.06 


.00 


VII 


5 


-1.06 


550 


-.04 


.00 


VII 


7 


0.39 


544 


.02 


.00 


VIII 


5 


0.20 


563 


.01 


.00 


VIII 


7 


-1.95 


537 


-.08 


.01 


IX 


5 


0.94 


536 


.04 


.00 


IX 


7 


1.69 


560 


.07 


.00 


X 


5 


0.05 


545 


.00 


.00 


X 


7 


0.02 


556 


.00 


.00 



a s obtained difference significant at .01 level 
b £ obtained difference significant at .001 level 
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impact. Our measure of exposure is not without problems. In certain schools 
there is only a handful of non-whites; however, the students can claim to have 
interracial exposure since they are asked the broader question of interracial 
exposure in classes or school activities , the latter possible in a racially 
homogeneous student population. This circumstance is not at all like a 
situation in which there is a heavy concentration of non-whites. When chil- 
dren from these two different exposure situations are lumped together as a 
group because of their same replies they can easily appear much more like the 
non-exposure students who come from predominantly small towns having few if 
any non-white resident s« , 

Shifts in Variances from Grade 5 to 7 

The exposure group exhibited a statistically significant, although slight, 
increase in variability at Goal VIII, The non-exposure group displayed a 
significant increase in variability at Goal IX and a significant decrease at 
Goal JI, 

Differences in Variability for Exposure and Non-Exposure Groups 

Only two of the 22 comparisons were found to be statistically signifi- 
cant at the .01 level. The incidence of significant differences approaches 
chance expectation. Furthermore, the largest variance ratio was only 1.3. 



CHAPTER VII 

DIFFERENCES AMONG LEVELS OF FATHER'S EDUCATION 

Presented on the succeeding pages are the statistical summary tables for 
the following groups: students who fathers have not completed high school 
(Table 17), students whose fathers have completed high school (Table 18) and 
students whose fathers have received some amount of education beyond high 
school (Table 19). For ease of communication these three groups will be 
referred to as low, middle and high FEDUC. 

Across Time Correlations 

In general, the pattern of across time correlations for the three groups 
Is similar. Each across time correlation for a particular group was sta- 
tistically compared with the respective correlation in each of the other 
groups. The technique used in contrasting correlations for j groups is 
described in Chapter II. A significant departure was found for only one of 
the 10 goal areas. This occurred for Goal I ( /^ = 7.98, df = 2, p < ,05). 
The low FEDUC group has a significantly lower correlation than the middle 
(z = 2.55, p < .02) and high (z = 2.28, p < .05) FEDUC groups. 

Shifts in Means from Grade 5 to 7 

Because of the larger number of groups for which results are given, the 
description and comparison of findings will be given for each goal separately 
except where group consistency was exhibited. Included in the description are 
the estimates of substantive signif icctnce which are given in Table 20. 
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Table 20 

Substantive Significance of Grade 5-7 Mean Shifts 
at Each Goal Area for Levels of Father's Education 



Group 


I 


II 


III-V 


III-M 


IV 


V 


VI 


VII 


VIII 




X 


Low 


.18 


.28 


1.17 


1.38 


.06 


.12 


.68 


.29 


.55 


.14 


.44 


Middle 


.15 


.16 


1.26 


1.25 


.26 


.04 


.74 


.06 


.72 


.07 


.24 


High 


.27 


.30 


1.36 


1.28 


.19 


.03 


.82 


.01 


.78 


.07 


.15 



As demonstrated by analyses in previous chapters large effects were 
found across groups for Goals III-V and III-M while moderate to large effects 
were found for Goals VI and VIII, Also consistent with previous results was 
the lack of significant change at Goals V and IX. 

For Goal I a significant increase occurred only in the high FEDUC group* 
The obtained difference qualifies as a small effect according to d« It should 
be pointed out that, although the observed change for the low and middle 
groups did not reach the significance criterion of .01, there was a gain in 
each case. This finding conflicts with the decrease observed by Trowbridge 
(1972) with essentially the same instrument given to children in grades 3 
through 8. Furthermore, as will be seen below, the self concept scores show 
a monotonic increase as FEDUC increases. By contrast the Trowbridge study 
found low socioeconomic children displaying higher means than a middle socio- 
economic group. 

Statistically significant gains of a small effect size were found in 
the low and high groups for Goal II. 

The only significant change at Goal IV occurred for the middle FEDUC 
group. Here, a decrement of a small effect size was formed. 

For Goal VII only the low FEDUC group exhibited a significant shift. 
The observed gain is the small effect range. 
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Significant increases at Goal X were observed for the low and middle 
FEDUC groups. The gain for the low group approaches a medium effect size 
while a small effect was attained by the middle FEDUC group. 

Differences in Mean Goal Scores for Father's Education Groups 

A perusal of Tables 17, 18 and 19 demonstrates once again the powerful 
effect of a socioeconomic variable. With rare exception the means show an 
increase as socioeconomic status increases. This is true at both grade 
levels. In some instances ihe mean at grade 5 for the high FEDUC group 
exceeded the grade 7 mean for the other two groups. 

One way analyses of variance were conducted at each goal/grade area. All 
revealed significant F ratios except Goals IX and X (both grades) and Goal IV 
(grade 7). As a follow up, the t' statistic was computed for each pair of 
groups. These results are displayed in Tables 21, 22 and 23. All 22 goal/ 
grade variables are presented for the sake of consistency with previous tables. 

Obviously, the largest differences occur between the high- low FEDUC 
groups. As Table 21 depicts, all differences u'ece statistically signifi- 
cantly significant with the exception of Goal IV at grade 7 and Goals IX and 

X. Of the 17 significant contrasts five reach Cohen's guiaoline for a large 
2 

effect (r = .37, r ::.17) and eight others reach criterion for a medium effect 
(r = .24, r^ = .06). The remaining four exceed the minimum for a small effect 
(r = .10, r^ = .01). For Goal IV the means differed significantly at grade 
5 but liot at grade 7. This was brought about by a non- significant increase 
(see Table 17) in the Goal IV mean for the low group and a non- significant 
decrease (see Table 19) for the high group. 

As shown in Table 22, 12 contrasts were statistically significant in the 
high-middle FEDUC groups. All of these are small effects. The high FEDUC 
group had significantly greater means at both grade levels for Goals III-V, 
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Table 21 

Suinmary cf High -Low FEDUC Mean Contrasts 



Goal 


Grade 


tj_ 


df ' 


r 


2 

r 


I 


5 


A.73b 


244 


.27 


.07 


I 


7 


5.58b 


258 


.31 


.10 


II 


5 


4.02b 


285 


.22 


.05 


II 


7 


4.02b 


285 


.22 


.05 


III-V 


5 


6.74b 


249 


.37 


.14 


III-V 


7 


7.54b 


289 


.39 


.15 


III-M 


5 


5.76b 


271 


.32 


.10 


III-M 


7 


4.78b 


281 


.26 


.07 


IV 


5 


3.37b 


265 


.20 


.04 


IV 


7 


1.07 


257 


.06 


.00 


V 


5 


5.30b 


270 


.30 


.09 


V 


7 


4.62b 


278 


.26 


.07 


VI 


5 


7.22b 


281 


.38 


.15 


VI 


7 


7.74b 


282 


.40 


.16 


VII 


5 


4.94b 


244 


.28 


.08 


VII 


7 


2.83a 


256 


.17 


.03 


VIII 


5 


5.93b 


258 


.33 


.11 


VIII 


7 


7.12b 


239 


.40 


.16 


IX 




0.66 


249 


.04 


.00 


IX 


7 


1.23 


270 


.07 


.00 


X 


5 


1.81 


250 


.11 


.01 


X 


7 


-1.00 


261 


.06 


.00 



a s obtained difference significant at ,01 level 
b =: obtained difference significant at .001 level 
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Summary o£ High 



Goal 


Grade 




I 


5 


1.76 


I 


7 


3.03a 


II 


5 


2.02 


11 


7 


3.06a 


III-V 


5 


3.94b 


III-V 


7 


4.06b 


III-M 


5 


3,29b 


III-M 


7 


2,89a 


IV 


5 


0.28 


IV 


7 


1.16 


V 


5 


2.70a 


V 


7 


2.66a 


VI 


5 


4.20b 


VI 


7 


3.88b 


VII 


5 


1.71 


VII 


7 


1.42 


VIII 


5 


3.96b 


VIII 


7 


2.95a 


IX 


5 


0.08 


IX 


7 


0.03 


X 


5 


1.27 


X 


7 


0.56 



a a obtained difference significant 
b s obtained difference significant 
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Table 22 
Middle FEDUC Mean Contrasts 



df ' 




r 


255 


.10 


.01 


271 


,17 


.03 


302 


.11 


.01 


299 


.16 


.03 


260 


,22 


.05 


286 


.22 


.05 


260 


.18 


.03 


276 


,16 


.03 


270 


.02 


.00 


258 


,07 


.00 


272 


.15 


.02 


281 


.15 


.02 


293 


.23 


.05 


295 


.21 


.04 


248 


.10 


.01 


253 


.08 


.01 


284 


,21 


.04 


264 


.16 


.03 


259 


.00 


.00 


254 


.00 


.00 


254 


.07 


.00 


277 


.03 


.00 



at .01 level 
at .001 level 
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Table 23 

Summary of Middle- Low FEDUC Mean Contrasts 



Goal 


Grade 




df 


r 


2 

r 


I 


5 


3.38b 


357 


.18 


.03 


I 


7 


2.71a 


357 


.14 


.02 


II 


5 


1.89 


360 


.10 


.01 


II 


7 


0.90 


360 


.05 


.00 


III-V 


5 


3.07a 


351 


.16 


.03 


III-V 


7 


3.83b 


341 


.20 


.04 


III-M 


5 


2.88a 


347 


.15 


.02 


III-M 


7 


2.12 


348 


.11 


.01 


IV 


5 


3.40b 


341 


.18 


.03 


IV 


7 


-0.08 


340 


-.00 


.00 


V 


5 


2.90a 


345 


.15 


.02 


V 


7 


2.15 


344 


.11 


.01 


VI 


5 


2.98a 


338 


.16 


.03 


VI 


7 


3.77b 


337 


.20 


.04 


VII 


5 


3.81b 


353 


.20 


.04 


VII 


7 


1.67 


349 


.09 


.01 


VIII 


5 


1.91 


351 


.10 


.01 


VIII 


7 


4.60b 


351 


.23 


.05 


IX 


5 


0.67 


356 


.04 


.00 


IX 


7 


1.36 


347 


.07 


.00 


X 


5 


0.63 


345 


.03 


.00 


X 


7 


-1.65 


347 


-.09 


.01 



a = obtained difference significant at .01 level, 
b = obtained difference significant at .001 level. 
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III-M, V, VI and VIII. For Goals I and II the two groups were not signifi- 
cantly different at grade 5 but do diverge significantly at grade 7. In both 
cases the high group displayed significant increases (see Table 19) while the 
middle group did not (see Table 18). This provides some evidence for a dis- 
ordinal interaction, with the high group demonstrating a gain in these two 
areas while the low group did not. 

Eleven of the comparisons between the middle and low FEDUC groups (see 
Table 23) were statistically significant. The middle FEDUC groups had 
significantly larger means at both grade levels for goals I, III-V, and VI. 
Of interest is the fact that the middle group showed a significant decrease 
at goal IV while no significant change took place for the low group. The 
difference between the groups at grade 5 was significant. This would indicate 
that the low group maintained the same level of interest in school whereas the 
middle group showed a decrease in interest* The low group was significantly 
lower in Goal VII at grade 5, but not signif icemtly different at grade 7. 
Although both groups gained in Goal VIII, the low FEDUC group appears to have 
achieved a greater increase. The two groups did not depart significantly at 
grade 5 but do differ significantly at grade 7. 

Shifts in Variability from Grade 5 to 7 

Essentially no changes in variability occurred for the three groups. 
Only two significant shifts out of 33 comparisons were noted, the incidence 
being at a chance level. One of these occurred for Goal III-V in the high 
FEDUC group (Table 19). The observed decrease in variability is undoubtedly 
due to a ceiling effect. A significant increase in variability was found for 
Goal IX in the low FEDUC group. 
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Differences in Variability Between FEDUC Groups 

Again the general theme was close comparability among variances. The 
only significant difference across groups took place at Goal II, III-V, VI 
and VIII, At Goal II, the middle FEDUC group was more variable than the high 
group at grade 5 (F = 1.71, df = 189, 123, p < .001) and grade 7 (F = 1,60, 
df = 189, 132, p < ,01), Greater variability was also exhibited by the 
middle group over the high group at grade 5 (F = 1,67, df = 179, 121, p < .001) 
and grade 7 (F = 1.82, df = 179, 121, p < .001). The low FEDUC group also 
demonstrated more variability than the high group on Goal VI at grade 5 (F = 
1.57. df = 163, 121, p < .01) and grade 7 (F = 1,81, df = 163, 121, p < ,001), 
The lone significant difference for Goal III-V occurred at grade 7. Here the 
low group exhibited greater variability than the high group (F = 1,70, df = 
170, 122, p < .001); however, the latter group was running into a ceiling 
effect which naturally incurs a restriction of range. The middle FEDUC group 
was more variable than the low group in Goal VIII at grade 5 (F = 1.40, df = 
172, 186, p < ,01) and grade 7 (F = 1,42, df = 172, 186, p < ,01), 

As will be noted, the magnitude of these variances ratios is not great. 
One may conclude that, for these data, no imports, .t discrepancies in varia- 
bility were found. 
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APPENDIX 

INFORMATION ON TEST BATTERY USED IN LONGITUDINAL STUDY 

The following is a brief description of the instrument used at each 
goal area. Internal consistency estimates of .reliability derived from the 
Phase II norming operation are included along with the number of items and 
and possible score range. The source of each instrument is also identified. 
Most of the information has been abstracted from Beers (1970) and Burson 
(1972). 

Goal I: Self Concept 

Number of items: 53 
Possible score range: 53-106 
Reliability (Coefficient alpha): .87 

Source: 45 items from Coopersmith* s (1967) Self Esteem Inventory plus 
8 items pertaining to "control of environment" were obtained 
from Educational Testing Ser\'ice. 

Description: The items reflect the following content areas: (1) control 
of environment--f eelings of confidence in one's ability to 
fulfill ambitions, (2) self-confidence in personal 
attributes--f eelings of self worth, (3) achieving in 
school- -one's self image in relation to teachers and the 
school setting, (4) relating to others--one* s relationship 
with parents and peers. 

Goal II: Understanding Others 
Number of items: 9 
Possible score range: 9-45 
Reliability (Coefficient alpha): .77 

Source: Items were developed by Educational Testing 'Service and later 
revised by Educational Quality Assessment. 

Description: Items pertain to attitudes toward those who differ in 
race 9 religion^ and economic status. 
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Goal III-V: Basic Skills - Verbal 
Number of items: 30 
Possible score range: 0-30 
Reliability (KR-20): .75 
Source: Educational Testing Service 
Description: Items are verbal analogies* 

Goal III-M: Basic Skills - Math 
Number of items: 30 
Possible score range: 0-30 
Reliability (KR-20): .75 
Source: Educational Testing Service 

Description: Items pertain to computational skills and problem solving. 

Goal IV: Interest in School 
Number of items: 17 
Possible score range: 17-85 
Reliability (Coefficient alpha): .75 

Source: Developed by Educational Testing Service and later modified by 
Educational Quality Assessment. 

Description: The items correspond to the following content areas: (I) 

perception of the school climate- -attitudes about teachers, 
school facilities and course offerings, (2) attitude 
toward school assignments-^opinions about homework, reading, 
writing and studying, (3) perception of the learning 
process--attitudes about teacher methods and school in 
general. 

Goal V: Citizenship 

Number of items: 44 



Possible score range: 44-220 
Reliability (Coefficient alpha): .90 
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Source: Bureau of Educational Research 

Description: The general item content is as follows: (1) Situational 
ethics- -what one would do when confronted with cheating, 
rule-breaking, losing or finding articles and helping 
others^ (2) Attitudes toward personal responsibility 
issues- -what one's attitude is toward cheating, rule- 
breaking, etc., (3) Concern for democratic principles-- 
opinions on civil rights, freedom of speech, etc,, (4) 
Initiative in advocating change- -would one criticize 
established order to effect change. 



Goal VI: Health Habits 
Number o£ items: 48 
Possible score range: 0-48 
Reliability (KR-20): .82 

Source: 35 items were adapted from the Health and Safety Education 

Test, Psychometric Affiliates and the remaining 13 items were 
prepared by Educational Quality Assessment. 

Description: Items tap knowledge of desirable health habits in areas 
of personal hygiene, first aid, food and nutrition, 
alcohol, smoking, drugs and environment hazards. 



Goal VII: Creativity 

Number of items: 39 
Possible score range: 39-195 
Reliability (Coefficient alpha): ,82 
Source: Bureau of Research 

Description: Items pertain to one's willingness to take risks and 

engage complex ideas, curiosity, degree of self direction 
and extent of flexible thinking. 

Goal Vlll: Vocational Development 
Number of items: 39 
Possible score range: 39-78 
Reliability (Coefficient alpha): .77 

Source: 39 items from the Crites (1969) Vocational Development Inventory. 
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Description: Items measure maturity of attitudes toward a career choi 
and the development of educational/occupational plans. 
The relative importance of work and the satisfactions 
derived are also measured. 



Goal IX: Appreciating Human Accomplishments 
Number of items: 21 



Possible score range: 21-63 

Reliability (Coefficient alpha): .79 

Source: Bureau of Educational Quality Assessment 

Description: Items tap the perceived importance and degree of desired 

participation in political, scientific, sports, literature, 
art, music and theater activities. 



Goal X: Preparing for a Changing World 
Number of items: 29 
Possible score range: 29-145 
Reliability (Coefficient alpha): .79 
Source: Bureau of Educational Quality Assessment 

Description: Items require students to project themselves into the 

future and indicate their degree of comfort with sweeping 
changes in societal regulations. Content includes the 
perceived importance of continued education in coping with 
change, opinions regarding changes in school, work and 
travel regulations and attitude toward change in school 
setting and instructional methods. 



